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Abstract 

We construct a diffeomorphism of the two-dimensional torus which 
is isotopic to the identity and whose rotation set is not a polygon. 



Introduction. 



The rotation set is an important invariant associated with a homeomor- 
phism of the two-dimensional torus. In the literature there are a number 
of different definitions of the rotation set, however all of these sets can only 
differ on the boundary. Moreover, all of the sets have the same convex hull 
which is equal to the Misiurewicz-Ziemian rotation set. This rotation set 
consists of all asymptotic average winding vectors exhibited by the system 
and is always a compact convex subset of the plane (0). 

A natural question is whether every compact convex subset of the plane 
is a rotation set for some torus homeomorphism. This question is still open. 
Even deciding which line segments are rotation sets is not yet resolved. Given 
any interval with rational slope passing through a point with rational coordi- 
nates it is easy to give a homeomorphism that has the interval as its rotation 
set. The construction in [0] implies that intervals with at least one rational 
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endpoint and irrational slope can be realized as well. Based on their results 
for time-one maps of toral flows Franks and Misiurewicz conjecture that these 
two are the only possibilities ([§]). 

In the case of nonempty interior, it is known that all polygons with ver- 
tices having rational coordinates can be realized as rotation sets (H). When 
the rotation set has interior, it depends continuously on the map (|§). This 
clearly implies that some sets which are not rational polygons must occur, 
however it is still possible that only polygons occur. In this note we show 
that this is not the case. We construct a C 1 -diffeomorphism whose rotation 
set is not a polygon. The regularity of the example is determined by the use 
of a circle homeomorphism exhibiting a wandering arc. By Denjoy's theorem 
wandering arcs do not happen in C 2 -category (0, ||). One is prompted 
then to ask whether there is a C°°-diffeomorphism whose rotation set has 
infinitely many extremal points? 



(0,p) 


extremal points 






(0,0) 


(P,0) 




Figure 0. 



The construction of a C 1 -diffeomorphism, G, whose rotation set is shown 
in Figure 0, goes roughly as follows. Pick a irrational number p. The one- 
dimensional skeleton of the two dimensional torus is a bouquet of two circles. 
Call one of them the vertical circle and the other the horizontal circle. The 
definition of G begins by defining a map F on this bouquet. The map F is 
the composition of two transformations. The first transformation is obtained 
by mapping the horizontal circle into itself by a circle homeomorphism which 
has a rotation number p and exhibits a wondering arc containing the common 
point of the two circles. Since we want the transformation to be continuous 
we must fold a piece of the vertical circle into the horizontal one, and we 
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keep this folding as simple as possible. The second transformation is defined 
analogously with the roles of the horizontal and vertical circles interchanged. 

The dynamics of the composition of the two transformations, F, will 
contain trajectories which remain on a fixed circle. These orbits all have a 
common average rotation rate p and give rotation vectors (0, p) and (p, 0). 
The trajectories which visit the vertical and horizontal circles repeatedly ac- 
count for all other extremal points except (0,0). Our ability to effectively 
calculate the rotation vectors of these trajectories stems from the fact that 
the essential part of the dynamics is controlled by an infinite Markov parti- 
tion. Indeed, for any given natural number n, the set of points on, say, the 
horizontal circle that jump to the vertical one after exactly n iterates is an 
arc. The collection of thus defined arcs has the Markov property. Section 
2 contains the details of the construction of the map F on the bouquet of 
circles. 

The next step is to "perturb" F to a C 1 -smooth embedding of a neigh- 
borhood of the skeleton into itself. The perturbation is carefully chosen so 
that its dynamics are as close as possible to those of the inverse limit of the 
map on the skeleton. An obvious difficulty arises at the trajectory of the 
common point of the vertical and horizontal circles. This is overcome by 
locking this point into a wandering domain. This is where the construction 
depends crucially on the use of a Denjoy example. It is a routine to conclude 
that the rotation set of the perturbed map is the same as that of F. To 
complete the construction, we extend the dynamics to G on the whole torus 
by putting a source in the complement of the neighborhood of the skeleton. 
This places the vector (0, 0) in the rotation set of G. The construction of the 
"perturbed" map with appropriate proofs can be found in Section 3. For a 
more general approach yet yielding only continuous embedding see Section 
4. 

Section 1: Preliminaries and statements of results. 

Let T 2 be the 2-dimensional torus R 2 /Z 2 and 7r : R 2 — ► T 2 the projection. 
For any compact subset X C T 2 , let X := 7r~ 1 (X) and denote by H(X) 
the set of all continuous F : X — > X satisfying F(x + v ) = F(x) + v for 
all x G X,v G Z 2 . Denote by H(X) all mappings F : X — > X that are 
projections of those in 7i(X). Notice that 7i(T 2 ) is the space of all continuous 
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maps of T 2 homotopic to the identity. For any F G 'H(X) we have the 
displacement function (p F : X — > R 2 defined by 4> F (x) := F(x) — x where x is 
a lift of x. We borrow the following definition from |7[]. 

Definition 1. For F G 'H(X) and a point x £ X, its rotation set p(F,x) is 
the set of all limit points of a sequence (-(F n (x) — x)) n6 N where x is a lift 
of x. This set is independent on the choice of lift x. The rotation set of the 
map is 

p(F) := P| cl ( |J - x) : x G X}) C R 2 . 

m>0 \n>m n / 

For F G we sei p(-F) := p{F) where F is a lift of F. This defines p{F) 

only up to translation by a vector in Z 2 . 

It is a useful general fact that the convex hull of the rotation set for any 
map is generated by the rotation sets of generic points of ergodic invariant 
measures. In particular, we have the following proposition. (Here we write 
Conv(A) for the convex hull of A C R 2 .) 

Proposition 1 ([0]). For any F G 'H(X) the following sets coincide : 
(i) Conv(p(F)); 

(ii) {/ <pp dp : p is an F — invariant probability measure on X}; 
(in) Conv (\Jp(F,x) : x G X such that p(F,x) is a pointj. 

Although we defined the rotation set for maps on subsets of the torus 
our primary interest is in the case when X = T 2 and F G 7i(T 2 ) is a 
homeomorphism. In this setting p(F) is a convex compact in R 2 (|7]]). Our 
main result is existence of a C 1 -diffeomorphism G G 7i(T 2 ) with p(G) which 
is not a polygon. To be more precise let us adopt the following definitions. 
(We use \x\ for the smallest integer greater or equal then x and [^J for the 
largest integer less or equal then x.) 

Definition 2. For any irrational p G (0, 1) we define a sequence of numbers 
(a n ) n6 N by the formula 

a n := \np] - np 
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and vectors p m>n in R 2 by 

._ ( \™p] , \np\ ) 

Pm,n ■— , ■ 

m + n + 1 

yl/so we define the convex set A p by 

A p := Conv{0, p m>n : rra,ra G N, a m < p, cc n < p}. 

Figure gives an indication of the shape of A p . The next proposition 
asserts a crucial property of this set, namely, that it is not a polygon. 

Proposition 2. For any irrational p G (0, 1), the set A p has infinitely many 
extremal points. There are exactly two accumulation points of the extremal 
points of A p , namely, (0,p) and (p, 0). 

Proof of Proposition 2. Recall that p m . n := {x mtn ,y m . n ) where 
x m ,n ■= \mp]/(m + n + 1) = (rrap + a m )/(m + n + 1), 

2/m,n := [rap]/(m + ra + 1)) = (rap + a n )/(m + ra + 1). 

Suppose m k ,n k G N, = 1,2,3... are such that x mk ,n k 0. Then n k /m k — > 
oo, so y mk ,n k is asymptotic to [ra^pl/ra^ and thus converges to p. On the other 
hand, sequences (m^), (ra^) with p mk ,n k G A p for which x mk>nk — ► exist due 
to irrationality of p. In this way the vectors p mj „ in A p which approach the 
!/-axis accumulate to (0,p). Also, since A p is contained in the first quadrant 
{(x, y) : x, y > 0} and contains the origin, it follows that (0, p) is an extremal 
point. 

Denote by 7 mj „ the slope of the line through p m n and (p, 0). We claim 
the following: 

If m k , n k with Pm k ,n k £ A p for k = 1,2, 3..., are such that 
lim 7 mfei „ fc = sup{7 mj „ : p m . n G A p }, 

k— >oo 

then 7 mfci „ fe is not eventually constant and lim*,^ p mk ,n k = (0,p). 
To prove this claim, note that we have 

_ n k p + a nk - p(m k + n k + 1) 
7mfe ' nfe " m fc p + a mfe 
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Since p is irrational a nfc 's can be arbitrarily close to p so it is clear that the 
supremum is > — 1 and is not attained. Thus either — > oo or n k — > 
oo. The first possibility leads to 7m fc ,n fe — > — 1 which is definitely not the 
supremum. It follows that m^'s are bounded and n k — > oo which gives 

Pm fc ,n fc -> (0,p). 

This last fact guarantees that (0, p) is a condensation point of extremal 
points. The same is true of (p, 0). In this way we have infinite number of 
extremal points. Moreover, using the formula for the slope 7 mi „ one can see 
that points p m>n accumulate towards the anti-diagonal {(x,y) : x + y = p}. 
Clearly there are no other extremal points on it except for (0, p) and (p, 0). 
This proves the second part of Proposition 2. □ 

Now we are ready to formulate our theorem. 

Theorem 1 (Main Theorem). For any irrational p G (0, 1) there is a 
C 1 — diffeomorphism G G H(T 2 ) whose rotation set p{G) equals A p (mod Z 2 ). 

An outline of the proof of Theorem 1 can be found in the introduction. 
Sections 2 and 3 give more formal arguments. 

Section 2: A map on a one-dimensional skeleton of the 

torus. 

Denote the x and y-axis in R 2 by R^ 1 ) and R( v ) respectively. These lines 
project to circles on T 2 which we call S w and S (u) . We put X := S w U S {v) 
and X := n~ l (X). We have obvious injections R/Z = S 1 — > for a G 
{h,v}. For x G S 1 we denote the corresponding point in by x^ G S^, 
a G {/i, f}. We also have a "projection" X — > S 1 sending rr x that is 
defined by the relation G X. 

Define the set Q p C R 2 by : 

il p := Conv{p m , n : a m , a n < p}, 
where p m ,n, Oi mi a n are as defined in Section 1. 
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We construct F : X — > X , F e Ti(X) with a rotation set 

p(F) = fi p (mod Z 2 ). 

This map is a composition of two analogous transformations of X. Roughly 
speaking, the first one is what one gets trying to rotate by a positive 
angle keeping the map continuous and the unavoidable folding of into 
as simple as possible. The other does the same to S^. The detailed 
definition preceded by some necessary preliminaries follows. 

We think of the one-dimensional circle S 1 as R (mod Z). Let / be a small 
symmetric closed arc around zero and / its lift to R containing zero. For 
: S 1 — > S 1 a degree-one map that is 1-1 everywhere except / where it has a 
plateau, let : R — > R be the lift satisfying r := 0(7) e [0, 1], (see Figure 1). 
As long as we are not concerned with the issue of smoothness, to make our 
construction work we need to pick any such a with the rotation number 
p(0) equal to p. 




Figure 1. 



However, since we ultimately want a C 1 -example we have to choose 
more carefully. We may start with a Denjoy C 1 -diffeomorphism of S 1 with 
rotation number equal to p. We may further require that it has a wandering 
domain slightly larger than /, say equal to the dilation of I by a factor of 
18/17 about the origin that we denote by 18/17 ■ I. Now since 18/17 • I 
is wandering, any modification of the diffeomorphism on this arc without 
altering its image does not affect the rotation number. In particular, we can 
redefine the map on 18/17- / so that / is sent to a point and C 1 -smoothness 
is preserved. This is the map we are ultimately going to take for 0. Let us 
stress at this point that we will not use wandering properties of until the 
considerations of Section 2. 
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There is a unique homeomorphism ip : S 1 — > S 1 such that (f> = ip o p 
where p collapses / to zero and is affine on the complement of I. Indeed, 
ip(x) := 0op~ 1 (x) for x ^ extends through because 0op _1 (O) = (f)(1) = r 
is a point. For our derived from Denjoy's example the map ip is C 1 -smooth. 

Let 7] : [— 1, 1] — > [0, 1] be given by the formula 77(2;) := 1 — x 2 . Take for 
?7 T : I — > [0, r] the map whose lift is a linear rescaling of i] to a transformation 
from / to [0, t}. The following definition gives for each a G {h, v} a continuous 
F ia) :X^X. (Here by definition h := v and u := h.) 

( iP(xY a Ui x eS^; 
F^\x) := \ r] T (x)W if x G /(*); 

[ p(x)(*) if x G S&\lW. 

Remark 1. T/ie definition is valid for any degree-one mapping <fi which is 1-1 
everywhere except a symmetric plateau around zero. Moreover, depends 
continuously on <p in the C° -topology. 

The map F is defined as a composition of F^ and F^ h \ 

It is easy to homotope F^ and F^ to the identity. In view of Remark 

1 one can do this by coming up with an appropriate homotopy connecting <j> 

to the identity. Say <f>t := ipt ° Pt where ipt '■= id + 1 ■ (ip — id) and pt collapses 

t ■ I to zero being affine on the complement of t ■ I. By lifting homotopies 

connecting F^ and F^ to the identity to homotopies also terminating at 

the identity, we get lifts of our mappings that we denote by F^ and p( v \ 

respectively. Both F^ and F^ belong to H(X). So does their composition 
p ._ p(y) p{h)_ 

Proposition 3. For F defined as above we have 

p(P) = n p . 

It is convenient to notice that in view of part (iii) of Proposition 1, Propo- 
sition 3 reduces to the following. 



8 



Proposition 4. 

(i) If for x G X the limit p(F,x) = lim n _ >00 ^(F n (x) — x) exists, then 

p(F,x) e tt p . 

(ii) For any m, n G N with a m , a n < p, there is x G X with p(F, x) = p m ,n- 

The remainder of this section is devoted to the proof of Proposition 4. 

Proof of Proposition 4. Since F = F^oF^ we will find it convenient 
to regard as the (forward) orbit of x G X the sequence xq, Xi/ 2 , x±, x 3 / 2 , x 2 , 
with Xq := x, X1/2 := F^ h \x), X\ := F(x), x 3 / 2 ■= F^ o F(x) ... . 

Looking at the definition of the map F^ we see that it preserves S^. The 
circle is not forward invariant, however the only part of that is folded 
into consists of which (by definition) is a symmetric neighborhood 
of the origin. For F^ we have analogous situation (with v and h switched). 

There are two types of (forward) orbits : 
eventually free, i.e. staying in the complement of 1^ U for all sufficiently 
high indices; 

interacting, i.e. having returns to 1^ U for arbitrarily large indices. (In 
fact returns to and 1^ must alternate.) 

To understand what happens in each of these two cases and develop useful 
notation we draw the following diagrams associated with the orbit of x G X. 

Case of free x Q G S w : 



x, 



X 



(h) 

1/2 



p(v) 



P 



x 



(h) 



X 



1> 



(h) 
3/2 



p{v) p(h) 



x 2 



X 



V 



1> 



(h) 

5/2 



p{v) p(h) 



X 



(h) 



P 



1> 



(1) 



Case of free x G S (t,) : 
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p{h) p(v) p{h) p{v) p(h) p(v) 
„( v ) . ~» (v) («) (f) /o\ 

p if) p if) p if) 



Case of interacting Xo G for which x m+ i/2 '■= F^oF m (x ) sits in /W 
and x m+n+ i = F m+n+1 (x ) is the first return to I^h 



p(h) p{v) p(h) p(h) p(v) p(h) p(h) 

_(«) , Jh) . (h) (h) („) („) 

x x l/2 x l x m+l/2 x m+l x m+3/2 

r^ T p V i> Vr P i> 



p(h) p(v) 
p if) 



T («) > > T («) 

x m+2 x m+rt+l 



The diagrams indicate which of or F^) acts and what the corresponding 
transformation of circle coordinate x is. For example, 



pih) 

"m+1/2 



-"■-in 7 



tells us that x m+ i/ 2 = FW(x m ) and 

^m+1/2 — ipjxm)- It also indicates that 
both x m and :r m+ i/2 belong to S^. (Ambiguity arising for = W = {v) 
will cause no confusion in our further discussion so it is ignored.) 

We see that if Xk stays on one of S^, o E {h,v}, for k — 0, |, 1, |, 2, 
then the projected coordinate Xk on S 1 evolves under the iterates of <f> = if) op 
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(i.e. Xk+i = 4>{x k )). When x k hits a G {h, v}, it makes a transition 

to the other circle through the folding action of rj T . Given m, n G N, 
all points xo G behaving according to diagram (|3|) form a set (perhaps 
empty) that will be denoted K$ n . That is, for any m, n G {0, 1, 2...}, we set 

-^mjn := {^o G : ^m+n+i is the first return to and x m +i/2 

Denote by /i : S 1 — >■ S 1 the unique semiconjugacy of to rigid rotation 
by the angle p such that h(0) = 0. We define H : X -> X by il(iW) : = 
/i(x) (<t) , (T G {M}- Notice that ff(jWu J (u) ) = (0,0), so in particular, if 
is a well defined continuous map. For if : X — > X C R 2 we take the lift of 
if preserving (0,0). 

Claim 1. If x £ X is as in (i) of Proposition 4 and x = ir(x), then 
(i) for x eventually free, p(F,x) G {(0, p), (p, 0)}; 

(^zj /or x interacting, p(F, x) belongs to Conv ^ HoF + m ^^- [ ~ H<yX " > : x = tt(x) 
eK$ n , m,n g n}. 

Proof of Claim 1. We start with a standard observation that for any 
H G H(X) the limits of sequences ^(F n (x) - x) and ±(H o F n (x) - H{x)) 
coincide. Indeed, since H(y) — y is a Z 2 -periodic function of y, we have 
\\H o F"(x) - F B (x)|| < sup SeR2 \\H(y) - y\\ < +oo. 

If x is eventually free, after skipping a finite number of iterates, we are 
in the situation of one of the two first diagrams. In the case of diagram 
(1) we write H o - H{x) = H(x l/2 ) - H(x ) + E k Zl(H(x k+1/2 ) - 

H(x k -i/ 2 )) + H(x n ) - H(x n -i/ 2 ). Since H(x k+ y 2 ) - H(x k - 1/2 ) = (p, 0) we 
get p(F, x) = (p, 0). Similarly in the case of diagram (0) we have HoF n (x) — 
H(x) = E n k =i(H(x k ) - H(x k ^)) = ELi(0,p), so p(F,x) = (0,p). 

For an interacting orbit we may assume that it starts in I w . Then we split 
it into segments between consecutive returns to F v \ Each such a segment 
(after obvious shift of indices) looks like that in diagram (^|). In particular, 
it has an associated (m, n) G N 2 such that x m+ \/ 2 G I {h) and m + n + 1 is 
the total length of the segment. Now if we take X G N such that xq, ...,xn 
is a certain concatenation of segments as above, then jr(H o F (x) — H(x)) 
is a convex combination of average displacements in each segment. □ 
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Let us now calculate the average displacement on the sets K$ . 

Claim 2. Ifn(x) G K$ n for some m, n G N, then 

H o F m+n+1 (x) - H(x) _ 

: : : — Pm,n- 

m + n + 1 



Proof of Claim 2. For x with 7r(:ro) = x E we nave 

H(x m+n+1 ) -H(x ) = (H(x 1/2 ) 7 H(x )) + ET=iWx k+1/2 ) - H(x k _ 1/2 )) + 
(H(x m+1 ) - H(x m+1/2 ) + Y%=i{H{x m+ i +1 ) - H(x m+ i)). 

Observe that H(x ) = H(x m+1/2 ) = H(x m+n+1 ) = (0, 0). Also H(^ r (I)^) = 
(-rp (mod Z))( CT ) for r G N, while x k+1/2 G (<j>- m+k (I))W for k = 0,...,m 
and x m+l+1 G ((f>~ n+l (I))^ for I = 0,..,n. Thus H(x m+n+1 ) - H(x ) = 
(-mp - [-mp\ ) • (1, 0) + mp ■ (1, 0) + (-np - [-np\ ) • (0, 1) + np ■ (0, 1) = 
( \mp] , \np] ) = (m + n + 1) • p m , n . □ 



Lemma 1. TTie sei K$ n is nonempty if and only if a m , a n < p. Moreover, 
if K$ n is nonempty, then it is a disjoint union of four subarcs of I^ v \ each 
mapped by F m+n+1 homeomorphically onto . 



Proof of Lemma 1. The arcs {0~- ? (/) (cr - ) }j e N are pairwise disjoint and 
ordered on in the same manner as the corresponding backward orbit 
of rigid rotation by p. Also rj T (I) = [0,0(7)]. In this way the set of all 
points in I which get folded by r\ T into 0~ m (J) is either empty or consists of 
a two arcs, each mapped by r\ T homeomorphically onto 0~ m (J). The set is 
nonempty exactly when —mp G (0, p) (mod Z), i.e. —mp — [— mp\ < p or 
equivalently a m = \mp] — mp < p. 

Now look at diagram (3). For a point x G to have x m+ i/ 2 as the first 
iterate hitting means that i] T (x ) G 4>~ m (I). In view of the preceding 
remarks such points Xq exist only if a m < p, and then they form two subarcs 
of /W, call them K x and K 2 . Note that under F m+1 / 2 = F m o F^ (which is 
essentially m o r\ T ), each of them maps homeomorphically onto I^ h \ 

Analogously, points x m+ i/ 2 in 1^ that have x m+n+ i as the first iterate 
hitting exist if and only if a n < p. As before, if a n < p, then those 
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points form two subarcs of I^ h \ call them L\ and L 2 . Under F n oF^ (which 
is essentially <p n o r/ T ), each of them maps homeomorphically onto 1^ (see 
diagram (3)). 

Now Kg> n is clearly equal to F^ m+1 ' 2 \L 1 U L 2 ) n (#i U K 2 ). This set, 
if it is nonempty consists of four subarcs of each mapped by F m+n+1 = 
pm+1/2 p(v) pn homeomorphically onto I^ v \ The lemma is proved. □ 

We are ready to conclude the proof of Proposition 4. To prove (ii), 
note that from Lemma 1 we see that for m, n with a m , a n < p the sets 
K $m F ~ (m+n+1) ( K $n)i F ~ 2{m+n+1) ( K $ n )i ••• are nested, so the intersection 
flfcLo F~ k( - m+n+1 \Kmn) i s nonempty. Take any x in this set. 

To prove (i) we have to consider two possibilities. For eventually free x 
we are done by part (i) of Claim 1 together with the fact that both (0, p) and 
(p, 0) belong to Q p . For interacting x we have to combine part (ii) of Claim 
1 with Claim 2. □ 



Section 3: A diffeomorphism of the torus from the 
map on the one-skeleton. 

Recall that || • / is a wandering arc under <p and set 



Shrinking • 7 we can get a symmetric arc I" containing I such that Jo : = 
p(I") is a nondegenerated arc and f] T (Jo) is contained in W (see Figure 2). 
Note that ip(J ) C W. Put 




I' := V ;\[0,r]\J ) 



and 



AJ :=cZ(J"\ /'). 



(See Figure 2.) 

For a E {h, v} put 



U {a) := {x G T 2 : dist(x, S (<t) ) < 1/4 • length(J )}; 
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18/17 / 



Figure 2. 



U 



= U {h) U U {v) . 



Also set 



C:={(x,y)eU 
There is a retraction r : U \ C - 



: \x\, \y\ < 1/2 ■ length(J )}. 
> X \ C given by 

(x,0) for G f/ (/l) ; 

(0,y) for G C/^. 



r(x,y) : 



Theorem 1 is a consequence of the following proposition which is the main 
result of this section. 



Let us first see how Theorem 1 follows from this proposition. 

Proof of Theorem 1. It is a routine to extend the map G acting on 
U C T 2 to a diffeomorphism on the whole T 2 by putting a single source 
outside U repelling all other points towards fln>o G n (U) (i.e. we require that 
T 2 \ f) n >oG n (U) is a basin of attraction under G" 1 ). For this extended G 
we have p(G) = Conv{(0, 0), = A p . □ 

The rest of this section is devoted to the proof of Proposition 5. 

Proof of Proposition 5. The construction of the C 1 -embedding G : 
cl(U) — > U is done in steps. 

Step 1. As suggested by Figure 3, we modify on to obtain 

: X — > U a C 1 -smooth embedding satisfying the conditions listed below. 




embedding G : cl{U) 



U such that 
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Figure 3. 



(A) (Fr)-\cl(C)) = A/M U ^- 1 (Jo) (ft) ; 

(B) F} h \cl(C)) Cr-^WW); 

(C) if x C U (Ff^-^C), then r o F[ h \x) = F^ h \x). 

Step 2. We extend F-^ to a C 1 -smooth embedding : cl(U) — ► [/ 
with the following analogues of conditions (A), (B), (C) satisfied : 

(A') (GW)- 1 (c/(C)) = r-^A/M U J ) (h) ); 

(B') G^(cl(C)) Cr-^WW); 

(C) if x £ C U (GW)-^), then r o GW(i) = o r{x). 

See Figure 4 for the construction of G^ h \ In the analogous way we obtain 
G('») from F^. 

Step 3. Finally we define G : cl(U) — > C/ by 

G := G {v) oG {h) . 

Let us now concentrate on these aspects of the dynamics of G that are 
critical for the calculation of the rotation set p(G). First let us see how 
alternating applications of G^ and G^ act on r~ 1 (W^) and r~ 1 (W^). 
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Figure 4. 



We expect that these domains are wandering under G and move "freely" 
governed by the action of (f> on the appropriate circle. We formalize this in 
the following lemma. (We deal with the case of r~ 1 (W^). For r~ 1 (W^) 
there is an analogous statement.) 



Lemma 2. For any M — 0, 1, 2... 

2N compositions 
, " ^ 

(a) if M is even andM = 2-N, then the setG (h) o G (v) o ... o 

is contained in r~ 1 ((fi N (W)^) which is disjoint from CU (C7^) _1 (C); 

2./V+1 compositions 

(b) if Mis odd andM = 2-N+l, then G {v) o G {h) o ... o G {h) o G {v \r~ l (W^)) 
is contained in r~ 1 {po(j) N {W)^) which is disjoint from CU(G^)~ 1 (C). 



Proof of Lemma 2. We proceed by induction on M. 
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For M = our claim follows from (A') for and the fact that W n 
(Jo U A/) = 0. 

Now we will describe the induction step. 

First we deal with part (b). By the inductive hypothesis and (C) for 

2N+1 
/ " .. 

we have r o G (v) o ... o G {v \r~ l {W^)) C r o o r' 1 (0 7V (W^)W) = 

27V+1 

ror- 1 oFW(/(lf)C')) = p o ^(W)^. Thus o ... o G { - v \r~ 1 (W { - K) )) C 

Now r-^p o ^(W) W) n C = follows from p o ^(W) n J = which is 
equivalent to ^opo0 Ar (^)n^(J o ) = JV+1 (W^)n^(J o ) = 0. Since ^(J ) C W 
and W is wandering this is true. 

On the other hand, r~ l (p o <p N (W^)) n (G (h) ) _1 (C) = in view of (A') 
follows from p o fl V~Vo) = or equivalently <f> N +\W) H J = 0, 

once again by the wandering property of W . 

Let us now consider part (a). By the inductive hypothesis and (C) for 

2N 

, " > 

wehaveroG w o...oG' M (r- 1 (W^) = roG^ or~ 1 (po<p N ~ 1 (W) {K) ) = 
ror'o i?W(p o ^-^W) W) = (^(p o ^-^W))^) = ^(W^W. 
Now r- 1 (0 Ar (W^)W)nC = follows from ^(W) H J = 0. On the other hand, 
using the version of (A') for we see that r^ 1 (0 7V (W^)W)n(G^)- 1 (C) = 
follows from 4> N {W) n A/ = 0. □ 

Now we are going to verify that the region C under iterations of G stays 
in the wandering domains of Lemma 2. This assures that all the rotationally 
nontrivial dynamics is carried on a certain forward invariant set £ on which 
r is a well defined semiconjugacy between G and F. The lemma below gives 
precise formulations. 

Lemma 3. If Crit := U£= C-n/2 = Un= G~ n (C U (G^)' 1 ^)) and E := 

(•J G(E) C S ; 

(ii) For any x G U there is N G {0, 1,2...} such that xn '■= G N (x) G S. 
Moreover, if x £ E £/ien t/iere exists iV G N suc/i t/iat either x N+k G 
r-^po/^W) /or all k EN or x N+k G r" 1 ^^^)^)) /or a// G N; 
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(Hi) The following diagram commutes 



E E 
r | | r 

r(E) r(E) 

Note that the nonwandering set of G is contained in E. Also the nonwan- 
dering set of F sits in r(E). 

Proof of Lemma 3. 

(ii) Suppose that x g 1 E . Then for some A G {1,2,...} we have x^-i G 
CU(G , W)- 1 (C). 

If xjv-i e G, then by (B') we have x N _ 1/2 = G w (s ff _i) G r 1 ^') and 
from Lemma 2 we conclude that for every k > 

2fc+l compositions 

A 

xjv+fe = G("> o (?W o ... o o G^Cx^va) 

is contained in r _1 (p o 0*(W)W). This set is disjoint from G U (GW) -1 (C7) 
so x N Crit. 

If Xat-i G (G^)-^, then x^_ 1/2 = (G (,i) )(xjv-i) G G and, by (B') for 
G^, we have x N = G^) (2^-1/2) G r~ l (W^). Applying Lemma 2 with the 
role of v and h interchanged we see that for every k > 

2k compositions 

XN+k = G {v) o G (/l) o ... o G (v) o G (/l) (^iv) 

is contained in r-\(f) k {W)^). This set is disjoint from C U (GW) _1 (C) and 
so x n G" Grit. 

(iii) Suppose that a; G" Grit, then x g" C U (G^) _1 (G) and xi/ 2 = 
GW(i ) ^GU(G("))- 1 (G). Indeed, otherwise x G GU(GW)" 1 (G)U(GWo 
CW)-i(c) c cWt. Thus we may apply (C) with x = x and (C) for G M 
with x = xi/2 to get r o G^ o GW(i) = o fW(r(i)). □ 

To conclude the proof of Proposition 5 we need to show that p(F) = 
p(G) = VL P . Observe that Lemma 3 part (ii) tells us that points x g" E 
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contribute only (0, p) or (p, 0) to the rotation set of G. The analogous state- 
ment is also true for F, that is, the contribution of points which are not 
in r(E) to the rotation set of F is either (p, 0) or (0, p). This contribution 
is due to free orbits on or correspondingly. Moreover, using the 
diagram in (iii) of Lemma 3 lifted to the universal cover we see that for 
any x G E, p(G,x) = p(F,r(x)). Indeed, we have ||G n (x) — F n o r(x)\\ = 
\\G n (x) — r a G n (x) || < sup- G £ \\f(y) — y\\ < oo. □ 



Section 4: Deriving invertible dynamics on the torus 
from noninvertible dynamics on a skeleton. 

In this section we want to indicate that, as far as one is ready to give up 
on smoothness requirements, there is a general method essentially replacing 
considerations of Section 3. The construction is fairly robust and intuitive, 
so we assume a very informal style to avoid blurring the essence with a cloud 
of details. 

Our approach is a variation of the method used by Barge and Martin 
(0|) to prove that inverse limits of interval transformations can be real- 
ized as attractors for homeomorphisms of the plane. The key fact is the 
following theorem which is an easy corollary of Morton Brown's results in 
[II]]. Let us recall that a continuous map / of a compact metric space Y is a 
nearhomeomorphism if and only if there exists a sequence of homeomorphisms 
f n : Y — > Y converging uniformly to /. 

Theorem 2. If Y is a compact metric space, then any nearhomeomorphism 
f : Y — > Y is a factor of a homeomorphism f of Y , i.e. there is a continuous 
onto map h : Y — > Y such that ha f = f ah. 

The paper of Brown is clear and puts the above theorem in a perspective 
of general facts about inverse limits. However, we feel it will be beneficial to 
the reader if we present here a self-contained proof of the result. 

Proof of Theorem 2. Let d be the metric on Y. Given any two maps of 
Y, say / and g, use d(f, g) to denote their uniform distance equal by definition 
to swp{d(f(x),g(x)) : x G Y}. Suppose that a sequence of homeomorphisms 
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(/n)neN converges uniformly to /. Compositions /i ° ... o f n and f n 1 o ... o f\ 1 
are denoted by fi >n and f~\ respectively. For any n G N set 

a n := sup{max{rf(/ li „_ 1 (x), /i, n -i(?/)), c?(/i,n-i ° /(z), /i,n-i ° /(?/))} 

: d(x,y) < d(f n ,f)}, 
P n : = sup{max{d(/i in _i(:r), /i, n -i(y)), d(/i,n-i ° /(z), /i,n-i ° /(y))} 

: < d(f n+1 ,f)}, 

7 n := »p{ ( l(r 1 (4r 1 (!/)) : d(x,y) < d(f,f n )}, 
e n := 3 • (a n + (3 n + 7„). 

Notice that skipping certain elements of the sequence (f n )^ =1 one can make 
the sequence (e n )^ =1 converging to zero as fast as we wish. Indeed, one can 
proceed inductively as follows. Suppose that we have already chosen fi, f n 
so that cki, a n , Pi, fi n -\ and 71, 7„ are as small as we wished. By the 
uniform continuity of the functions /i, n , /i, n _i, f 1>n o f, / 1>n _i o / and / n , 
by picking f n+1 sufficiently close to / we get a n+ i, f3 n and 7„ +1 as small as 
we wish. This ends the induction step. In this way we may assume that 
£e„ < 00. 

We claim that the sequences consisting of the following maps of X are 
uniformly convergent : 

fn '■= /l,n+l /n,l> 
9n := fl,n /n+l,l5 

hn := fo/J. 

This claim already implies the theorem. Indeed, we have g n °fn = fn°9n = 
idx and /i n+ i o / n = / o h n . Consequently, the limits, denoted by /, g, h 
correspondingly, satisfy f°g = g°f = idx and h o f — f o h. 

Convergence of the sequences is an immediate consequence of the assump- 
tion about the convergence of the series of e n 's and the following estimates 
valid for any x G X. Setting y := f r ~l(x) we see that 

d(fn(x)J n -l(x)) = 

d{f hn+1 o f~l(x), f hn o f-^x)) = d(/i, n -iO f n o f n+1 (y), /i,„_io f n o f n (y)) < 



20 



d(fi, n -i ofo f n +i(y), /i,n-i ofo f{y)) + d(/i,„_i ofof n (y), /i >n _i ofof(y))+ 

d(fl,n-l°fn°fn+l(y), /l,n-l°/°/n+l (?/) ) +d(fl, n -l°fn°fn (y) , /l,n-l°/°/n(S/)) < 

Similarly taking fn+i,i{x) for y we get 

d(&»(aO,&»-i(aO) = 

d(/l,n ° /n+1,1' A.n-1 ° ^l) = ^(/l.n-l ° fn(y),fl,n-l ° fn+l(y)) < 

d(fi, n -i o f n (y), /i, n _i o /(j/)) + d(/ 1)n _! o / n+ i(y), /i >n _i o /(y)) < 

/3 n -|- Q; n ^ 6 n . 

Finally using y := we obtain 

d(/i n (x),/i n _i(x)) = 

rf(r ° /^w, r _1 o /--Vo*)) = d (/ n_1 ° /(y). r _1 ° /»(!/)) < 

□ 




Figure 5. 



We will now explain how Theorem 2 enables us to find a torus homeomor- 
phism with rotation set equal to A p . Section 1 and Section 2 are prerequisites 
for our considerations. In particular, one should look there for definitions. 
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For the space Y in Theorem 2 we take the torus T 2 . For the map / we need 
a homotopic to the identity nearhomeomorphism which is an extension of 
the map F : X -> X to the whole torus and has X = S (/l) U S M as a global 
attractor. Such a map / would have the desired rotation set. Construction 
of the map / is not difficult. Once again it is convenient to obtain it as a 
composition of two maps and f( v \ We will roughly sketch the construc- 
tion of now. To get interchange the role of horizontal and vertical 
directions. 

First we take an embedding of X into the torus such that its post- 
composition with the map collapsing the marked annulus (see Figure 5) onto 
along vertical fibers is equal to F^ h \ Next we extend to a homeo- 
morphism of T 2 which we are going to denote with the same letter. We also 
extend the collapsing map to a mapping p^ of T 2 . These extensions need 
to be reasonably chosen since we want X to be a global attractor. For 
we take the composition o g( h \ This is a nearhomeomorphism because 
is one: the maps p^ contracting the annulus along the vertical direction 
by a factor say \jn are homeomorphisms that approximate it. 

From Theorem 2 we get a homeomorphism / of which / is a factor. This 
map has the same rotation set as / - it is equal to A p as required. 

The last implication hinges on the fact that the factor map is homotopic 
to the identity and the following simple observation. 

Fact 1. If f,f,r : T 2 — > T 2 are continuous, homotopic to the identity and 
satisfy f o r = r o /, and furthermore F, F , R : R 2 — > R 2 are their lifts such 
that F o R = R o F, then p{F) = p(F). 

Proof. The map R is surjective and, for any x G R 2 , we have ||F ra (:r) — 
F n o R(x)\\ = \\F n (x) - R o F n (a;)|| < sup yeR \\R(y) - y\\ < oo. The fact 
follows now trivially from the definition of the rotation set. □ 

If r is not homotopic to the identity, it induces a linear map r* on the 
first real homology which we identify with the universal cover R 2 . Then 
p(F) = r^(p(i 71 )), provided r* is nonsingular (or at least r is surjective). To 
see this one can modify slightly the above proof, or just compose r with the 
linear torus automorphism covered by r^ 1 and use Fact 1. 

Let us end with a remark on the continuity of the dependence of / on /. 

Remark 2. If /* : Y — > Y, t e [0, 1] is a homotopy of nearhomeomorphisms 
and there exists a sequence of isotopies /* : Y — > Y, t e [0, 1] converging 
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uniformly in t to f f , then one can assure that the family of maps /* from 
Theorem 2 is also a homotopy. 

To see why the remark is true, observe that the dependence of maps /* on 
t is continuous if only all estimates in the proof of the theorem are uniform 
in t. This uniformity would follow if we choose the approximating family f l n 
in the proof so that e n := sup{e^ : t G [0,1]} has as before a finite sum 
J2 e n < oo. One achieves this by analogous inductive procedure as that from 
the beginning of the argument. 
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